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• Abstract 

O ■ 

' We study the power- versus-distortion trade-off for the transmission of a memo- 

ryless bivariate Gaussian source over a two-to-one Gaussian multiple-access channel 
with perfect causal feedback. In this problem, each of two separate transmitters 
observes a different component of a memoryless bivariate Gaussian source as well 
as the feedback from the channel output of the previous time-instants. Based on 
the observed source sequence and the feedback, each transmitter then describes 
its source component to the common receiver via an average-power constrained 
Gaussian multiple-access channel. From the resulting channel output, the receiver 
wishes to reconstruct both source components with the least possible expected 
squared-error distortion. We study the set of distortion pairs that can be achieved 
by the receiver on the two source components. 

We present sufficient conditions and necessary conditions for the achievability of 
a distortion pair. These conditions are expressed in terms of the source correlation 
and of the signal-to-noise ratio (SNR) of the channel. In several cases the necessary 
conditions and sufficient conditions coincide. This allows us to show that if the 
channel SNR is below a certain threshold, then an uncoded transmission scheme 
that ignores the feedback is optimal. Thus, below this SNR-threshold feedback is 
useless. We also derive the precise high-SNR asymptotics of optimal schemes. 
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1 Introduction 



This is a sequel to the work in p] where a bivariate Gaussian source is to be transmitted 
over a Gaussian multiple-access channel. The new element here is the presence of 
perfect causal feedback from the channel output to each of the transmitters. As in pQ, 
our interest is in the power-versus-distortion trade-off. 

Our setup consists of a memoryless bivariate Gaussian source and a two-to-one 
Gaussian multiple-access channel with perfect causal feedback. Each of the two trans- 
mitters in the multiple-access channel observes a different component of the source as 
well as feedback from the previous channel outputs. Based on the feedback and the 
observed source sequence, each transmitter then describes its source component to the 
common receiver via an average-power constrained Gaussian multiple-access channel. 
From the output of the channel, the receiver wishes to reconstruct both source com- 
ponents with the least possible expected squared-error distortion. Our interest is in 
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characterizing the pairs of squared-error distortions that can be achieved simultaneously 
on the two source components. 

We present sufficient conditions and necessary conditions for the achievability of a 
distortion pair. These conditions are expressed in terms of the source correlation and 
the signal-to-noise ratio (SNR) of the channel. In several cases the necessary conditions 
and sufficient conditions are shown to agree. In particular, we show that if the channel 
SNR is below a certain threshold, then an uncoded transmission scheme is optimal, 
and feedback is useless. We also show that, in general the source-channel separation 
approach is suboptimal, but that it is asymptotically optimal as the transmit power 
tends to infinity. 

2 Problem Statement 
2.1 Setup 

Our setup is illustrated in Figure [TJ A memoryless bivariate Gaussian source is con- 




Figure 1: Bivariate Gaussian source with one-to-two Gaussian multiple- access channel 
with feedback. 

nected to a two-to-one Gaussian multiple-access channel with perfect causal feedback. 
Each transmitter of the multiple-access channel observes one of the source components 
and wishes to describe it to the common receiver. The source symbols produced at 
time k £ Z are denoted by iS^fc). The source output pairs {(<Sifc, £2,*:)} are 

independent identically distributed (IID) zero-mean Gaussians of covariance matrix 

/ o\ pcri£7 2 \ 

Kss = , (l) 

where p E [—1)1] and < af < 00, i S {1,2}. The sequence {Si^} of the first 
source component is observed by Transmitter 1 and the sequence {5*2, fc} of the second 
source component is observed by Transmitter 2. The two source components are to 
be described over the multiple-access channel to the common receiver by means of 
the channel input sequences {Xi^} and {X 2 .k}, where £ M and x 2 .k £ K- The 
corresponding time-/c channel output is given by 

Yk = Xi t k + X 2i fc + Zk, (2) 

where Zi~ is the time-k additive noise term, and where {Z^} are IID zero-mean variance- 
iV Gaussian random variables that are independent of the source sequence. 

We consider block encoding schemes and denote the block-length by n and the asso- 
ciated n-sequences in boldface, e.g. Si = (Si,!, Si,2> • • • , <Si,n)- Transmitter i £ {1, 2} 
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is described by a sequence of functions /•? : M n x — > R, A; = 1, . . . , n, which, for 
every time instant k G R produce the channel input Xj jt from the source sequence Sj 
and the so-far-observed feedback sequence Y k ^ 1 = (Y\, . . . , Yfc-i), i.e. 

X i , h = $(s i ,Y k - x ) ie {1,2}. (3) 

The channel input sequences are subjected to expected average power constraints 

1 n 

-E E K*]<^ <€{1,2}, (4) 
fc=i 

for some given Pj > 0. 

The receiver is described by two functions ^j™"* : R n — > R n , i G {1,2}, each of which 
forms an estimate of the respective source sequence S» based on the observed channel 
output sequence Y. Thus, 

S, = ^(Y) t€{l,2}. (5) 

We are interested in the pairs of expected squared-error distortions that can be 
achieved simultaneously on the source-pair as the blocklength n tends to infinity. In 
view of this, we next define the notion of achievability. 



2.2 Achievability of Distortion Pairs 

Definition 2.1. Given a%, o<i > 0, p G [—1, 1], Pi, P2 > 0, and N > we say that the 
tuple (Di, D2, af, erf, p, P±, P2, N) is achievable if there exists a sequence of encoding 
functions ({fx^ }&=i> if 2k }fe=i) as ™ ©> satisfying the average power constraints (|3J), 

and a sequence of reconstruction pairs (<$^ , 4^ ) as in ([5j) , such that the average 
distortions resulting from these encoding and reconstruction functions fulfill 



hm — E 

n^oo n — ' 
fc=l 
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<D i: ie {1,2}, 



whenever 

Y k = /<2(Si, Y k - V ) + /g(S 2 , Y'- 1 ) + Z fcj for fc G {1, 2, ... , n}, 

and where {(iSi fc, S2 k)} are HD zero-mean bivariate Gaussian vectors of covariance 
matrix K$s as i n CQ) an d {Zt} are IID zero- mean variance- iV Gaussians that are inde- 
pendent of {(5i,fc, <S2,fc)}. 

For given af, a^, p, Pi, P2, and iV, we wish to find the set of pairs (Di,!^) such 
that (Z>i, D2, of, erf, P, Pi , P2, N) is achievable. Sometimes, we will refer to the set of 
all (Z?i, D2) such that {D\, D2, a\ , u|, p, Pi, P2, iV) is achievable as the distortion region 
associated with (a\, of, p, Pi, P2, iV). In that sense, we will often say, with respect to 
some (01, cr 2 , p, Pi, P2, A r ), that the pair (Z?i,.D 2 ) is achievable, instead of saying that 
the tuple (Di,D2,c7i,a2, p, P±, P2, N) is achievable. 



3 



2.3 Normalization 



For the described problem we now show that, without loss in generality, the source law 
given in (JTJ) can be restricted to a simpler form. This restriction will ease the statement 
of our results as well as their derivations. 

Reduction 2.1. For the problem stated in Sections 12.11 and 12.21 there is no loss in 
generality in restricting the source law to satisfy 

a 2 =a\=o 2 and p G [0, 1]. (6) 

Proof. The proof follows by noting that the described problem has certain symmetry 
properties with respect to the source law. We prove the reductions on the source 
variance and on the correlation coefficient separately. 

i) The reduction to correlation coefficients p S [0, 1] holds because the optimal 
distortion region depends on the correlation coefficient only via its absolute 
value \p\. That is, the tuple (Di, D2, a 2 , a 2 , p, Pi,P2,N) is achievable if, and 
only if, the tuple (Di, D2, o\ , cr| , — p, Pi, P2, N) is achievable. To see this, note 
that if ({/i ( J}Li'{/2 ( J}fc=i>i n) ^2 n) ) achieves the distortion (D 1 ,D 2 ) for the 
source of correlation coefficient p, then ({/i^ }fc=D {/^ }fe=D ^1 >02 1 )> wnere 

^(Si.y*- 1 ) = /^(-Si,^- 1 ) and = -<^ n) (Y) 

achieves (Di,!^) on the source with correlation coefficient —p. 

ii) The restriction to source variances satisfying o~\ = o~\ = a 2 incurs no loss of 
generality because the distortion region scales linearly with the source variances. 
That is, the tuple {D\, D 2 , <rf, a 2 , p, Pi, P 2 , N) is achievable if, and only if, for 
every ai,a 2 G K + , the tuple (aiDi, a.2P>2-, olio\, olig\, P, Pi,Pi, N) is achievable. 
This can be seen as follows. If ({ /1 ^ }fc=i 5 { /ifc }ft=l ' ) achieves the 
tuple (Di,D2, o\,o\,p, Pi,P-i, N), then the combination of the encoders 

/^(Si.y*" 1 ) = f^\8 i / y /cH,Y k - 1 ), i e {1,2}, 
with the reconstructors 

^ (n) (Y) = V^-4 n) (Y), ie{i,2}, 

achieves the tuple (aiDi, a 2 D 2, olig\, a 2 a 2 , p, Pi, P2, N). And by an analogous 
argument it follows that if (aiDi,a2D2,aio-i,a 2 o-%,p,Pi,P 2 ,N) is achievable, 
then also (Di , D 2 , a\ , a\ , p, Pi , P2 , N) is achievable. □ 

In view of Reduction 12 . 1 1 we assume for the remainder that the source law addition- 
ally satisfies ©. 

2.4 "Symmetric Version" and a Convexity Property 

The "symmetric version" of our problem corresponds to the case where the transmitters 
are subjected to the same power constraint, and where we seek to achieve the same 
distortion on each source component. That is, P\ = P2 = P, and we are interested in 
the minimal distortion 

D*(a 2 ,p,P,N) =mf{D: (D,D,a 2 ,a 2 , p,P,P,N) is achievable}, 
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that is simultaneously achievable on {S± k} and on {S 2 k}- I n this case, we will often 
express the distortion D*(a 2 , p, P, N), for some fixed a 2 and p, and as a function of the 
SNR P/N. 

We conclude this section with a convexity property of the achievable distortions. 

Remark 2.1. If (Di , D 2 , o\ , a\ , p, P\ , P2 , N) and {D\ , D 2 , a\ , u\ , p, P\ , P 2 , N) are achiev- 
able, then 

(\Di + \b x , XD 2 + XD 2 , a 2 , alp, XP 1 + XPi, XP 2 + XP 2 , N^j , 
is also achievable for every A G [0, 1], where A = (1 — A). 

Proof. Follows by a time-sharing argument. □ 



3 Main Results 



3.1 Necessary Condition for Achievability of (Di,D 2 ) 

To state our necessary condition we first introduce three rate-distortion functions. They 
are: the rate-distortion function Rg lt s 2 (Di, D 2 ) on {(Si±, S 2t k)}', the rate-distortion 
function Rg^g 2 (Di) on {Si^}, when the component {S 2i k} is observed as side-information 
at both, encoder and decoder; and the rate-distortion function Rg 2 \g 1 (D 2 ) on {S 2 ^} 
when the component {S± k} is observed as side-information at both, encoder and de- 
coder. For {(Si t k, &2,k)} jointly Gaussian as in ([1]) with a\ = a 2 = a 2 , the two latter 
functions are given by 



R Si\S 2 ( D l 



R 



S 2 \Si 



(D 2 



~log 2 + 



1, + 

2 l0g2 



a\\-p 2 



o 2 a 



D 2 



(7) 
(8) 



The function Rs lt s 2 (Di, D 2 ) is given in the following theorem. 



Theorem 3.1 (Xiao, Luo [3]; Lapidoth, Tinguely [H[2]). The rate- distortion function 
Rs 1 ,s 2 (Di,D 2 ) is given by 



f M 



R Sl ,s 2 (D 1 ,D 2 ) = { 




D!D 2 



if(Di,D 2 ) e & 
if(D u D 2 ) e & 2 

if(D u D 2 )e^3. 



(9) 



Dl D 2 - (pa* - y /(a^D 1 )(^-D 2 )j 

where log^(aj) = max{0, log 2 (aj)}, D mm = min{Di, D 2 } and where the regions 
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and £^3 are given by 

@ 1 = i^D 1 ,D 2 ): 0<Di ^(l-p 2 ), D 2 > a 2 (l - p 2 ) + p 2 D r , 
a 2 {\ - p 2 ) <D X < a 2 , D 2 > a 2 {l - p 2 ) + p 2 D 1 , 

Dl -a 2 (l-p 2 ) 



D 2 < 



• 2 = { (D U D 2 ) : < D 1 < a 2 (l - p 2 ),0 < D 2 < (a 2 (l - p 2 ) - D x 



P 2 



a 



2 



a 2 -D, 



(D 1 ,D 2 ) : 0<D 1 <<r 2 {l-p 2 ), 



2 



(a 2 (l - p 2 ) - Di)— — < D 2 < a 2 (l - p 2 ) + p 2 D 1] 

a z — D\ 



o 2 (A - p 2 ) <D,< a 2 , Dl ^ p2) <D 2 < a 2 (l - p 2 ) + p 2 D 1 



Our necessary condition is now as follows. 

Theorem 3.2. A necessary condition for the achievability of(D\, D 2 , a 2 ,o~ 2 , p, P\, P 2 , N) 
is the existance of some p G [0,1] such that 



R SuS2 (D 1 ,D 2 ) < -log 2 I 1+ — I (10) 

i? Sl |5 2 Pl) < ^og 2 (l + Pl(1 ~^ ) (11) 

R S2 \ Sl (D 2 ) < \ log 2 (l + P2[l ~ p2) ) ■ (12) 

Proof. See Appendix [Aj □ 

We now specialize Theorem 13.21 to the symmetric case. To this end, we first substi- 
tute the rate-distortion functions i?5 l5 s 2 (Di, D 2 ), R Sl ^g 2 (Di), R S2 \ Sl (D 2 ) on the LHS 
of (fTOj) - (fP2j) by their explicit forms given in ([9]) , ([7|) , and ([8|) respectively. Substituting 
{D,D) for (-Di,-D 2 ) in dfoD & ([9]) yields that if (£>,£>) is achievable, then 



D > < 



2 I JV+2P(l+p) 



_2 / jV(l-p 2 ) - f ^ 



(13) 



JV+2P(l+p) 11 AT ^ T^?" 

Similarly, from (HU) & ([7]) [or ([12]) & we obtain that if (£>, £>) is achievable, then 

n> „2 ^(1-P 2 ) ^ 

Denoting the RHS of (USD by £(cr 2 , p, P, TV, /3) and the RHS of (0 by V(<x 2 , p, P, N, p), 
gives the following lower bound on D*(a 2 , p, P, N): 
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Corollary 3.1. In the symmetric case 

D*(a 2 ,p,P,N)> min max {£(a 2 , p, P, N, p), ^(a 2 , p, P, N, p)} . 

0<p<l 

The minimization over p is discussed in the following remark. 

Remark 3.1. For P/N < p 2 / (2(1- p)(l + 2p)) the minimum in Corollary 13. II is achieved 
by p* = 1, and for all larger P/N the minimum is achieved by the p* satisfying 

£(o 2 ,p,P,N,p*) = ^(a 2 ,p,P,N,p*). 

As P/N — > oo it can be shown that p* tends to one and hence Corollary 13.11 yields 



P/N^oo » JV V 4 



(15) 



In the next section we show that the liminf in (|15p is a limit, and that it is achieved 
by source-channel separation. 



3.2 Source-Channel Separation 

We now consider the set of distortion pairs that are achieved by combining the optimal 
scheme for the corresponding source-coding problem with the optimal scheme for the 
corresponding channel-coding problem. The source-coding problem is illustrated in 
Figure The two source components are observed by two separate encoders. These 
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Figure 2: Distributed source coding problem for a bivariate Gaussian source. 

two encoders wish to describe their source sequence to the common receiver by means 
of individual rate-limited and error-free bit pipes. The receiver estimates each of the 
sequences subject to expected squared-error distortion. A detailed description of this 
problem can be found in [U [5]. The associated rate-distortion region is given in the 
next theorem. 

Theorem 3.3 (Oohama [3]; Wagner, Tavildar, and Viswanath [5j). For the Gaus- 
sian two-terminal source coding problem (with source components of unit variances) a 
distortion-pair (D\,D2) is achievable if, and only if, 



(Ri,R 2 ) e fti(Di) n K 2 (D 2 ) n K snm (D 1 ,B 2 ), 



where 



ftlODi) 

n 2 (D 2 ) 
n mTa (D x ,D 2 ) 



(Rl,R 2 ):Ri > -log+ 



(R X ,R 2 ):R 2 > -log+ 



1 



)-2R 2 



)) 



Do 



(R l ,R 2 ):R 1 + R 2 >-\og+ 



;i-p^(l-2-^)) 

(l-p 2 )f3(D 1 ,D2) 
2D ± D2 
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with 

4p 2 DiD 2 



0(D u D 2 ) = 1 + Jl + 



(1-p 



2\2 ' 



The capacity region Cfb{P\, P2, N) of the Gaussian multiple-access channel with 
feedback was derived in [6] and is restated in the following theorem. 

Theorem 3.4 (Ozarow |6j). The capacity regionCFB(Pi, P2, N) of the Gaussian multiple- 
access channel with perfect feedback is 

C FB (P 1 ,P 2 ,N)= |J Urx,R 2 ) : Ri < \\og 2 (l + Pl{1 ~ p2) ) 



0<p<l 



2 oz 1 N 



2 oz V N 

The distortions achievable by source-channel separation are now given in the fol- 
lowing Corollary. 

Corollary 3.2. A distortion pair (Di,D 2 ) is achievable by source- channel separation 
if, and only if, 

K(D 1 ,D 2 )nC FB (P 1 ,P 2 ,N)^$. 

From the sufficient condition of Corollary 13.21 and the necessary condition of Theo- 
rem 13.21 we can now derive the high-SNR asymptotics of an optimal scheme. To state 
these asymptotics, we denote by (D^D^) an arbitrary distortion pair resulting from 
an optimal scheme. 

Theorem 3.5 (High-SNR Distortion). The high-SNR asymptotic behavior of {D\, L^) 
is given by 



r P\+ P2 + 2a/ P1P2 n * n * 4,-. 2^ 
iv™ N Dl ° 2 = a{l -P^ 

provided that D* < a 1 and D2 < o~ 2 , and that 

N N 
fcp^D* = ° and ^oP^ = °- (16) 

Proof. See Appendix [Bj □ 

Remark 3.2. The asymptotics of Theorem 13.51 are almost the same as those in [H 
Theorem 4.5] for the setup without feedback. The only difference is that in the case 
with feedback the power term P x + P 2 + 2p^JP x P 2 is replaced by Pi + P 2 + 2^P 1 P 2 . 
This stems from the fact that with feedback, as P/N — > 00, the cooperation between 
the transmitters can be full. 

Remark 3.3. Note that under source-channel separation, which achieves the high-SNR 
asymptotics, the cooperation between the transmitters takes place only at the channel- 
coding level. The source-coding is performed in a distributed manner. 
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To conclude this section we restate Theorem 13.51 more specifically for the symmetric 
case. Since there D\ = D 2 = D*(a 2 , p, P, N), condition (fl~6|) is implicitly satisfied. 
Thus, 

Corollary 3.3. In the symmetric case 




^D* FB (a 2 ,p,P,N) = a 2 ^-^. 
3.3 Uncoded Scheme 

We now revisit the uncoded scheme of [U Section 4.3], which was shown to be optimal 
for the setup without feedback whenever the SNR is below a certain threshold. For 
our setup with feedback, we show that this scheme is still optimal whenever the SNR 
is below the threshold of [Tl Section 4.3]. This result implies that below this SNR- 
threshold feedback is useless^ Note, however, that feedback is beneficial for the source- 
channel separation approach because, even if noisy, it increases the capacity region of 
the Gaussian multiple-access channel [7]. 

The uncoded scheme operates as follows. Encoder i £ {1 , 2} produces a time-A; 
channel input Xn~ which is a scaled version of the time-A; source output S$ k . The 
scaling is such that the average power constraint of the channel is satisfied. That 
is, 




X i,k = \-? S i,k faraUfc€{l,2,...,n}. 



The decoder reconstructs the source output by performing the MMSE estimate of 
Si,k, i £ {1, 2}, k 6 {1, 2, ... , n}, based on the time-fc channel output Y k . That is, 

Sf ;k = E[S i>k \Y k }. 

The expected distortions (D^, D 2 ) resulting from this uncoded scheme as well as its 
optimality below a certain SNR-threshold are stated in the following theorem. 

Theorem 3.6. The distortion pairs (Df,D 2 ) resulting from the described uncoded 
scheme are given by 

2 (l-p2)P 2 + N , (l-f?)P 1+ N 

L>i = a -j^=^ L>2 = o 



P1+P2 + 2p^7\P^ + N 1 P1 + P2 + 2p^/7\P 2 + N' 

These distortion pairs (D^D^) are optimal, i.e., lie on the boundary of the distortion 
region, whenever 



P 2 {1- p 2 ) 2 [P 1 + 2p^P 2 ) <Np 2 [2P 2 (l- p 2 ) + N). (17) 



Proof. The expressions for D\ and D 2 are derived in [U Appendix D]. The optimality of 
the uncoded scheme is proven in Appendix O For the particular case where Pi, P%, N 
satisfy (|17p with equality, the optimality can also be verified directly from Theorem l3.21 
To this end, it suffices to notice that for (D\,D2) = (DfjD^), the necessary condition 
of Theorem l3.2l is satisfied with equality for p* = p. It thus follows that for any (D^D^) 
satisfying D[ < Df and D' 2 < D 2 or D[ < and D 2 < D 2 the necessary condition 
of Theorem 13.21 is violated for every p £ [—1,1]. And hence, the uncoded scheme is 
optimal. □ 



1 By the simple structure of the uncoded scheme, it follows that feedback is useless not only in terms 
of performance, but also in terms of delay and complexity. 
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Corollary 3.4. Source- channel separation is in general suboptimal. 

Proof. This can be verified by comparing the achievable distortions given in Corol- 
lary 13.21 with the achievable distortions given in Theorem 13.61 For example, in the 
symmetric case it can be verified that for all p > and P/N < p/(l — p 2 ), the smallest 
distortions achievable by source-channel separation (Corollary 13. 2p are strictly larger 
than the distortions resulting from the optimal uncoded scheme (Theorem 13. 6|) . □ 

Remark 3.4. From Theorem 13.61 it follows that if Pi, P2, N satisfy (|17p with a strict 
inequality, then the necessary condition of Theorem 13.21 is not sufficient. This is due 
to the constraints (jlip and (|12|) which are loose at low SNRs and is best seen in the 
symmetric case. In the symmetric case, Theorem 13.21 (cf. (|lip and (|12p ) yields that for 
(D, D) to be achievable, it is necessary that D satisfy 

D> -° 2{l -»^ N + p(i-?y < 18 » 

i.e., that flU]) hold. Since p £ [0, 1], the RHS of (JIHJ) is upper bounded by a 2 (l - p 2 ). 
Thus, for sufficiently low SNRs the constraint of (|18p is inactive, and the only active 
constraint is the one of (|13p . But, if only (I13p is active, then p* = 1, which cor- 
responds to fully cooperating transmitters, and thus, yields a loose lower bound on 
D*{a 2 ,p,P,N) at low SNRs. 

We conclude the section on our main results by restating Theorem 13.61 more specif- 
ically for the symmetric case. 

Corollary 3.5. In the symmetric case 

I? (. ,p,P,AT) = a ______ ^<T37- ( 19 ) 

4 Summary 

We studied the power-versus-distortion trade-off for the transmission of a memoryless 
bivariate Gaussian source over a two-to-one average-power limited Gaussian multiple- 
access channel with perfect causal feedback. In this problem, each of two separate 
transmitters observes a different component of a memoryless bivariate Gaussian source 
as well as the feedback from the channel output of the previous time-instants. Based 
on the observed source sequence and the feedback, each transmitter then describes 
its source component to the common receiver via an average-power constrained Gaus- 
sian multiple-access channel. From the resulting channel output, the receiver wishes 
to reconstruct both source components with the least possible expected squared-error 
distortion. Our interest was in the set of distortion pairs that can be achieved by the 
receiver on the two source components. Our main results were: 

• A necessary condition (Theorem 13. 2p for the achievability of a distortion pair 

• The precise high-SNR asymptotic behaviour (Theorem 13. 5p of optimal transmis- 
sion schemes, which in the symmetric case (Corollary I3.3P is given by 



lim J^-D*(a 2 ,p,P,N)=a 2 \P—^. 
p/n-,oo V N y ' K ' ' ' V 4 
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and which is shown to be achievable by source-channel separation. 



The optimality, for all SNRs below a certain threshold, of an uncoded transmis- 
sion scheme, which ignores the feedback (Theorem I3.6j) . In the symmetric case, 
this optimality result (Corollary 13. 5p is given by 



2P(l + p) +JV" N ~ 1 -p 2 ' 

A Proof of Theorem Q 

In Theorem [32] we have given a necessary condition for the achievability of a distortion 
pair [D\ , D 2 ) for the multiple-access problem with feedback. The proof of this necessary 
condition uses the following two lemmas. 

Lemma A.l. For our multiple- access setup with feedback, let {Xij.}, {X2k} an d {Y k } 
be the channel inputs and channel outputs of a coding scheme achieving some distortion 
pair (Di,D 2 ). Then, for every 5 > there exists an uq{5) > such that for all 
n > tiq{S) 



nR SuS2 (D 1 + 5,D 2 + 5)<Y / HXi, k ,X 2tk ;Y k ), (20) 

k=l 

n 

+ < J2l(X ljk ;Y k \X 2ik ), (21) 
fc=i 

n 

nR S2lSl (D 2 + 5) < ^2l(X 2 ,k]Y k \X ltk ). (22) 
fc=l 

Proof. The proofs of (|20l) - (|22p follow along the lines of the proof for the univariate 
analog (see e.g. page 15]). The main ingredients in those derivations are the convex- 
ity of the rate-distortion functions and the data-processing inequality. We start with 
the proof of (|20p . By the definition of an achievable distortion pair (Di,D 2 ) (Defini- 
tion ^. ip and by the monotonicity of Rs lt s 2 {Ai, A 2 ) in (Ai, A2), we have that for every 
5 > there exists an no (5) > such that for every n > no(5) 

(1 n 1 11 \ 

- ^2 E [(^1,* - Si, k f] , - Yl E [o^.* - s 2 , k f] 
n fc=i n fc=i / 

a ) ^ 1 / r -1 r 

< n 22 - R Si,s 2 y E \(S lik - Si jk ) 2 , E \(S 2 , k - S 2 ,k) 



n 

k=l 



y j min I(S 1 ,S2]T 1 ,T 2 



fc=l P Tl,r 2 |Sl,S2 



E[(Si-Ti) 2 ]<di 
E[(S2-T 2 ) 2 }<d 2 



- i(si,ki s 2 ,k~, Si <k , s 2)k ) 
k =i 

n n 

= h(Si >k , S 2 ,k) — h(^i,k, S 2jk \Si ik , S 2:k ) 



k=l k=l 
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- ^2 h(Si,ki S2,k) — ^2 h(Si,k, S2,fc|Si, S 2 , S^ 1 , <S 2jl 1 ) 
fe=i fc=i 

= /i(Si,S 2 ) - /i(Si,S 2 |Si,S 2 ) 

= /(Si, S 2 ; Si, S 2 ) 

</(Si,S 2 ;Y), (23) 

where in step a) we have used of the convexity of i?5 X) 5 2 (Z)i, D 2 ), and in step 6) we 
have used the data-processing inequality. The RHS of (|23|) can be further bounded as 
follows 

J(S 1 ,S 2 ;Y) = /i(Y)-/i(Y|Si J S 2 ) 

n 

= / l (Y)-^/ l (y fc |Si,s 2 ,y 1 fc - 1 ) 

k=l 

n 

< h(Y) -Y,HY k \Si,S 2 ,Y 1 k - 1 ,X lik ,X 2tk ) 

k=l 

n 

= h(Y) - ^2 h(Yk\ x i,k, X 2 ,k) 

k=l 

n n 

< J>(Y fc ) -J2 h ( Yk \ Xl > k > X2 ^ 

k=l k=l 

n 

= Y J I{X 1M ,X 2M ;Y k ), (24) 

k=l 

where inequality a) follows because given the channel inputs X\ ^, X 2 ^, the channel 
output Yfc is independent of (Si, S 2 , Y^ 1 ). Inequalities ([23]) and (f24"P combine to prove 
(®. 

The derivations for (|2ip and (|22p are similar to the one for (|20p . Since there is a 
symmetry between the derivation of (|2ip and the derivation of (I22p . we only give the 
derivation of (|2ip . By the definition of an achievable distortion pair (D\,D 2 ) and by 
the monotonicity of i?5 1 |5 2 (Ai) in Ai, we have that for every 5 > there exists an 
no (5) > such that for every n > uq(5) we have 



nR Sl]S2 (D 1 + 5)< nR Sl]S2 ^ £ E [(S ljfc - Si, fe ) 2 ] j 



a ) ^ 1 

< n 

' n 
k=l 



dl,k 



= min I(S ltk ;T k \S 2:k ) 

k=l T k\ s l,k> s 2,k' 
^(S lth -T k ) 2 ]<d lth 

n 

- y] i{si,k> Si t k\s 2: k) 
fc=i 

n n 

= / ' J h(Si t k\S2,k) - / ' J h(Si,k\Si 1 k, S2,, 



fc=l fc=l 
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= Y Hs 1 , k \s k 1 ; 1 1 ,s 2 ) - Y h(s hk \s lyk , s 2 

k=l k=l 

n n 

<^h(S hk \S k 1 ; 1 \S 2 )-Y,HSi,k\Si^2,S k 1 ; 1 1 ) 

k=l 

n 

= Y, ^O^l.fc' Sl|S2, S^ 1 ] 



k=l 



k=l 

= /(Si;Si|S 2 ) 
</(Si,Y|S 2 ) 



(25) 



where step a) follows by the convexity of Rs 1 \s 2 (Di) and step b) follows by the data- 
processing in equality, i.e. 

J(S i; Y, Sx|S 2 ) = /(S i; Si|S 2 ) - /(Si; Y|S X) S 2 ) 



>o 



/(Si;Y|S2)-/(Si;Si|Y,S 2 ). 



The RHS of (125f) can be further bounded as follows 
/(S 1 ;Y|S 2 ) = / l (Y|S 2 )-/ l (Y|S 1 ,S 2 ) 

n n 

= Y h{Y k \Y k -\ S 2 ) - Y M^ISi, S 2 , Y k ~ l ) 



k=l 
n 



k=l 



YHYk\Y 1 k -\S 2 ,X 2 ^)-YHYk\Si,S 2 ,Y 1 k - 1 ,X hk ,X 2yk 



k=l 



k=l 



a) 



<Y h (yk\x 2 , k )-Y h ( Y k\ x hk,x 2tk 

k=l k=l 
n 

/ J I(Xi ; kl Y k \X 2jk ), 



(26) 



k=l 



where a) follows because given the channel inputs Xx kj X 2fk , the channel output Y k is 
independent of (Si, S 2 , Y^ -1 ). Inequalities (f25j) and (f26j) combine to prove (f2Tj) . □ 



xh 



< 



Lemma A. 2. Let {Xi k } and {X 2k } be zero-mean sequences satisfying Ym=\ ^ 
nPi, i E {1)2}. LetY k = X\ & + X 2 k + %k> where {Z k } are IID zero-mean variance-N 
Gaussian, and where for every k, Z k is independent of (Xi >k , X 2>k ). Let p n € [0, 1] be 
given by 

;EL E[Xi ifc X 2jfc ] 



Pn 



n Sfc=l ^ Xf u ) ( - Ylk=l ^ 



Y 2 
A 2,fe 



(27) 



Then 



k=l 
n 



2^ /(Xi jfc , X 2jfc ; Yfc) < - log 2 I 1 H 



iV 



^/(x lifc; y fc |x 2ife )<|io g2 (i + 



k=l 



N 



(28) 
(29) 
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j^I(X 2 ^Y k \X hk ) < ^log 2 (l + P2(1 ■ . (30) 

k=i ^ ' 

Proof. See [61 pp. 627]. □ 

Proof of Theorem VJ.°A The proof now follows by jointly bounding the expressions on 
the RHS of (|20|) , (f2T|) , and (|22|) by means of Lemma \A.2\ and using that for n — > oo 
Lemma |A. II holds for every 5 > 0. □ 

B Proof of Theorem 13.51 

For p = 1 the result follows by noting that the multiple-access problem reduces to a 
point-to-point problem where D* = D\. Hence, we shall now assume 

p<l. (31) 

The result can then be obtained from the necessary condition for the achievability of 
a distortion pair (Di,D 2 ) in Theorem 13.21 and from the sufficient conditions for the 
achievability of a distortion pair (Di,D 2 ) that follow from source-channel separation 
in Corollary 13.21 

By Corollary 13.21 it follows that a distortion pair (D\, D 2 ) is achievable if D\ < a 2 , 
D 2 < cr 2 and 

Lh > a 2 2- 2R ^ (1 - p 2 ) + a 2 p 2 2 -2(R 1+ R 2 ) (32) 
D 2 > a 2 2- 2R *(l - p 2 ) + ^^2-2^+^) (33) 
D 1 D 2 = CT 4 2 -2(i?. 1+ /? 2 ) (1 _ p2) + a y 2 -4(Ri+R2) j (34) 

where the rate-pair (R±, R2) satisfies for some p G [0, 1] 

^<-\^{^) (^) 

E.<\^m^m (36) 



#1 + #2 < g lo S2 ( ^ J • (37) 

If we restrict ourselves to distortion pairs (Di,D 2 ) satisfying 

TV iV 

lim = and lim = 0, (38) 

JV-0P1D1 N^oP 2 D 2 

and to p satisfying (|31|) . then for sufficiently small iV > the constraints (|32|) and 
(|33p become redundant. Consequently, for N sufficiently small, any distortion pair 
(Di,D 2 ) satisfying (J38]) and fl34]), where (Ri,R 2 ) satisfies (j35]) - (j3"7j) for some p G [0, 1], 
is achievable. And because for any fixed p G [0, 1) as N — > the Constraints (|35p and 
(f36l) become redundant, it follows that any distortion pair satisfying ([38]) and 



1- P1+P2 + %PV P1P2 f. n 4 h 2n / Qn \ 

A™ jv = CT ( p )' ( 39 ^ 
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for some p G [0, 1), is achievable. Since p can be chosen arbitrarily close to 1, a simple 
calculus argument shows that 

& iV = CT I 1 - P )> ( 40 ) 

is achievable. 

Next, let (D*(a 2 ,p,Pi,P2,N),D%(a 2 ,p,Pi,P2,N)) be a distortion pair resulting 
from an arbitrary optimal scheme for the corresponding SNR, and let (D^, D2) be the 
corresponding shorthand notation for this distortion pair. By Theorem 13.21 we have 
that 

RsiM D i> D v ^ 5 g2 1 iv J' ^ ' 



If (£>i,£>|) satisfies 



iV TV 

lim = and lim = 0, (42) 

N-M)PiD* N^oP 2 D* ' V ' 



then for N sufficiently small 



R Sl ,s 2 (Dh Dt) = \ log+ J . ( 4 3) 



by Theorem IQ and because (D*,D 2 ) € £^ 2 - From flU} and (03]) we thus get that if 
{Pl,D%) satisfies (02]), then 

Um Pi+P 2 + 2VTO ^ > 4(1 _ 2) (44) 
tv^o iV 1 2 - \ r j \ j 

Combining (00} with (0H) yields Theorem [33J □ 

C Proof of Theorem SJ2 

Theorem 13.61 states that for the multiple-access problem with feedback, if Pi, P 2 , N 
satisfy (|17p . then the uncoded scheme is optimal, i.e. no pair (D\,D 2 ) satisfying D\ < 
Df and D 2 < D% or satisfying D\ < D\ and D 2 < D% is achievable. For Pi, P 2 , iV 
satisfying (|17p with equality this was proven right after Theorem 13.61 Thus, here we 
restrict ourselves to Pi, P 2 , N satisfying (fT7|) with strict inequality. 

We now show the inachievability of every (D\,D 2 ) satisfying D\ < D\ and D 2 < D 2 . 
The inachievability of every (D\,D 2 ) satisfying D\ < -D" and D 2 < L>2 follows by 
similar arguments and is therefore omitted. The main step in our proof follows by 
contradiction. More precisely, we show that a contradiction arises from the following 
assumption. 

Assumption C.l (Leading to a contradiction). For Pi, P 2 , N satisfying (|17p with 
strict inequality, there exist encoding rules {ffl } satisfying the average power con- 
straints (0]), which, when combined with the optimal conditional expectation recon- 
structors 

Si = E[Si|Y], i€{l,2}, (45) 
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result in 



lim 

n^oo n 



such that 



i n 



Si 



fc=i 



ie {1,2}, 



(46) 



(Dt, D* 2 ) eint(^ 3 



and 



1)5 = D% 



2' 



(47) 



where we have denoted by int(^) the interior of 



Once a contradiction from Assumption IC.ll is established, it will follow that As- 
sumption IC.ll is false and the proof of Theorem 13.61 will follow in Section IC.3I 



Assume that Assumption IC.ll is true. Let {ffy } be a sequence of encoding func- 
tions, with resulting channel inputs {X± i k,X2 t k} and resulting channel outputs {Yfc}, 
which, when combined with the optimal conditional expectation reconstructors Si = 
E[Si|Y] and S2 = E[S2|Y] result in distortions (DIjD^) as defined in ([4U]) and sat- 
isfying (|47p . The contradiction based on Assumption lC.il will be obtained by deriving 
contradictory lower and upper bounds for the expected squared-error that Transmit- 
ter 2 can achieve at the end of the transmission on the sequence W = Si — pS2- To 
this end, let <^( n )(S2, Y) be some estimator of W from (S2, Y) and let D\v(tp^) be 
the mean squared-error associated with it: 



n 



|W-^ n )(S 2 ,Y) 



Based on Assumption lC.il we now derive a lower bound on D\y((p( n ^). 



C.l "Lower Bound" on LVO (n) ) 
In this section we show that 

Assumption ELD ^ f lim D w (^) > a\l - p 2 )——JL V^A . (48) 

\n-«X) N + Pi{l — p z ) J 

The idea in showing (|48p is to exploit the fact that the sequence W is independent of 
S2, and that therefore the only information that Transmitter 2 receives about W is via 
the feedback signal Y. Roughly speaking, we then show that if Y allows for "good" 
estimates of Si and S2, i.e. if D* < D± and D 2 = D 2 , then Y can only contain "little" 
information about W, and hence Transmitter 2 can only make a coarse estimate of W. 
The main element in showing (|48p is given by the following lemma. 

Lemma C.l. Let p n be as defined in (|27p . Then 

7 (Sl ;Y| S2 )<=lo g2 (l + ^t(lz^ 

and 

Assumption lC.il =>■ lim p n > p. 

n— >oo 

Proof. Combining (|26p with Lemma I A. 21 Inequality (|29p gives 



16 



with p n as defined in (|27p . It now remains to show that Assumption IC.ll implies that 
lim w _ >00 p n > P- To this end, we recall that from [TJ Proof of Theorem 4.1] we have 
that if Pi, P 2 , N satisfy (|T7|) . then the corresponding (D^,D 2 ) satisfies [TJ Condition 
(14) of Theorem 4.1] with equality, i.e., 

Rs u S 2 ( D h D 2) = g lo §2 (1 + ^ )• ( 49 ) 

Next, we notice that since Assumption IC.ll guarantees that (Dl,D 2 ) is achievable, it 
follows from Lemma [A. II that for every 5 > there exists an n'{5) > such that for all 
n > n'(S) we have 

a) n 

nR Su s 2 (Dl+5,D* 2 +5) <Y,HXi, k ,X 2tk ;Y k ) 

k=l 

b ) n f P 1+ P 2 + 2p n ^P 2 \ 
<-log 2 (l + I, (50) 

where a) follows from (|20l) in Lemma I A. 11 and b) follows from Lemma |A. 21 Taking the 
liminf of (|50p yields that for every 5 > 

-RSi,^ (^1 + 5 > ^2 + 0) < n l0 §2 1 + 



2 oz V ^ 

where p* = lim n _ >0O p n . And since Pl5 1)( s 2 (.Di, D 2 ) is continuous in (Z?i,.D 2 ) it follows, 
upon letting <5 tend to zero, that 



d rr>* r>*\ ^ 1 1 ^1 , Pi + P2 + 2p*V P1P2 \ , K1 , 
^SiAPl.^) ^ 2 g2 I iV J' ' ' 

By Assumption IC.ll and by the strict monotonicity of Rs lt s 2 (Di, D 2 ) as a function of 
D 1 in int(£F 3 ), it follows from the hypothesis D{ < Df and D\ = D\ that 

R Sl ,s 2 ( D i: D %) < R Sl MD*i,D* 2 ). (52) 

Combining (l52l) with ([51]) and (|49j) gives lim^^ p n > p. □ 
We next prove that 

Dw(<P {n) ) > " p 2 )2-| / ( Sl ^ Y l S2 ). (53) 

To derive (|53p . denote by Pvy(-D) the rate-distortion function for a source of the law 
of W. We then have 

nR w (D w (^)) < 7(W;^)(S 2 , Y)) 

</(W;Y,S 2 ) 

= /(Si-pS 2 ;Y,S 2 ) 

= / i (S 1 -pS 2 )-MSi-pS 2 |Y,S 2 ) 

= /i(Si - pS 2 |S 2 ) - h(Si - pS 2 |Y, S 2 ) 
= MSi|S 2 )-/ i (S 1 |Y,S 2 ) 

= /(Si;Y|S 2 ), (54) 
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where inequality a) follows by the data-processing inequality and the convexity of 
R\y(-). Inequality b) follows by the data-processing inequality, and c) follows since 
S2 and Si — /9S2 are independent. Substituting R\y (Dyy (f^)) on the LHS of by 
its explicit form gives 



n f a 2 (l — p 2 ' 



2 



Rewriting this inequality establishes f)53[) . 

Lemma IC.ll and Inequality (j53H combine to prove (148p . We next derive an upper 
bound on Dwif^)- 

C.2 "Upper Bound" on minimal Dw((p^) 

We now present an estimator y3( n )(S 2 , Y) for which we show that 

Assumption EH lim" D w {<f> M ) <a 2 {l- p 2 ) AT N ^, (55) 

u^oo TV + -Tl(l — p) 



for some monotonically increasing sequence {n^} of integers. From Implications (|55p 
and (|48p we then conclude that Assumption IC.ll is false. The estimator y?( n )(S 2 , Y) is 
given by 

^)(S 2 ,Y)^aS!-/3S 2 

= aE[Si|Y] -/3S 2 , 

where the coefficients a and (3 are given by 



a 2 

a ^ S L (56) 



a A V^ 2 -^)^ 2 -^)-^ 2 -^) 
-^2 



with (D\, D%) as in Assumption IC.ll The idea for showing that for this estimator (|55p 
holds, is to exploit the fact that if Y allows for a "good" estimate Si of Si, i.e. if 
D\ < Df, then Transmitter 2 can also make a "good" estimate of W, based on S 2 
and Y. To show this we first notice that Assumption IC.ll implies that there exists a 
monotonically increasing sequence of integers {n^} such that 

1 n " r i 
lim — VE \(S iik -S iik ) 2 =Dt i€{l,2}. (58) 

k=l 

We now derive (|55p using the following two lemmas. 

Lemma C.2. For every 5 > there exists an vq{5) such that for all v > vq{8) the 
following inequalities hold 

1 n " r i 

-E E PM% > a 2 - I?! - <5, (59) 

- E E fcl ^ - D * + ^ ( 6 °) 
nv k=i L J 

-^E[s 1)fc S 2 J < J(a 2 -Dl)(a 2 -D*) + 5(a 2 +5). (61) 



v k=i 
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Proof. See Appendix IC, 4 



□ 



Lemma C.3. Assumption \C. l\ and in particular (D^D^) € S>z implies that the coef- 
ficients a and (5 defined in ([56]) and (I57D satisfy 



a > and (p - fi) > 0. 
Proof. Follows by noting that for every (D^D^) € S>z 

^ a 2 {1 _ p 2 ) _ Dl) _^_ i£0<Di<o*(l-f), 
^-^-^ 1 if^>a 2 (l-, 2 ). 

Using Lemma IC.2I and Lemma IC. 31 we now prove (|55[) as follows: 
£V(^)) = -E[||W-£(S 2 ,Y)|| 2 ] 



(62) 



□ 



— E (Si,* - P-SVfc - aSi k + 0S 2 ,k) 

v k=l 

1 n " r 

— e (Si fc - aSi^. - (p - z?)^; 



k=l 



2aE 



Si,kSi,k - 2(p - P)E[S l!k S 2 ,h 



+ a 2 E 



S 2 . fc +2a(p-/3)E S 1>fc S 2jfc 



+ (P"/5) 2 E[5 2 2 fc ]). 



(63) 



Using Lemma IC. 21 and Lemma fC.31 as well as E[5ifc] = E[S2,fc] = o 2 and E[5i fc52,jfe] = 
per 2 , we now get that for Pi, P%, N satisfying (|17p and for every <5 > there exists an 
vq[5) > such that for all u > vq(5), 

Dw{v {nv) ) < ° 2 ~ Mo 2 ~ D{ -5)- 2(p - P)pa 2 

W(a 2 -Df + S) + 2a{p - f3) (j(a 2 - D*)(cr 2 - D*) + 5{a 2 + S)\ 

+(p-/3)V. (64) 

Letting v tend to infinity and then 5 —* we obtain from (|64p that 

En A^O^) < tr 2 - 2a(cj 2 - D*) - 2(p - (3)pa 2 



+«V 2 - D{) + 2a(p - P)\/(a 2 - D\){(j 2 - D*) 

Hp - V 



2 Pv /(a 2 - Dl)(a 2 - D*) + D* + D* - g 2 (l + p 2 

n* 



(65) 



where in the last step we have replaced the terms a and (3 by their expressions in ([56 
and (I57p . To conclude our upper bound we now make use of one last lemma. 
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Lemma C.4. For all (D^D^) E mt(^) the expression on the RHS of is strictly 
increasing in D\. 



Proof. Denote by D\y the RHS of (I65jl . The proof follows by showing that for all 

(d;,»2) eintfsy 

fi!i>o. 

This follows by direct differentiation and by noting that for (D^D^) £ int(£^3) 
.2/1 „2\ n*\ o- 2 ;c n ^ n* ^- ^2/1 „2 



D% > 



if^>^(i-p 2) . D 

Since D\ < D\ and D* 2 = D% it follows from ([65]) and Lemma IC.4I that 



lim D w ({p^>) < a 



K)w 2 2 PvV ~ £>i )(* 2 ~ -°2 U ) + Pi + ^ ~ ^(1 + P 2 



2 jV(l ~ P 2 ) , RR x 

= " Pi(i-^) + a ' (66) 

where the last line follows from replacing Df and L>2 by their expressions given in 
Theorem 13.61 Thus, we have proven (|55p . 



C.3 Concluding the Proof of Theorem 13.61 

It follows from (|48[) and (|55p that Assumption IC.ll is false. We now show that this 
implies that if Pi, P2, N satisfy (|17p with strict inequality, then no pair (Pq,!^) 
satisfying Di < and D2 < £>2 or satisfying D\ < and D2 < D% is achievable. 
To prove this we assume p > because for p = Condition (fT7|) becomes P1P2 < 
and is therefore never satisfied with strict inequality. 

Our arguments are given in the following sequence of statements: 



A) If Pi, P 2 , N satisfy (JT7D with strict inequality, then the set of (D\, D%) satisfying 
(@7J) is not empty. 

Statement A) holds since if Pi, P2, N satisfy (|17p with strict inequality, then 
{D\, Dfj G int(^ 3 ) and int(^ 3 ) / whenever p ± 0. 



B) If Pi, P2, N satisfy (|17p with strict inequality, then there do not exist encoding 
rules, that, when combined with the optimal conditional expectation reconstruc- 
ted, result in (D^D^) as defined in ([16]) satisfying 

D{ < D\ and D^ = D^, 

(with {D\,DD in or outside int(^ 3 )). 

Statement B) can be shown by contradiction. If a coding scheme as described in B) 
were to exist, then by time-sharing it with the uncoded scheme — for which (D" , D2 ) G 
int(^3) — and by Statement A), we would obtain a scheme for which (D*, D2) satisfies 
(|47|) . in contradiction to the fact that Assumption IC.ll is false. 
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C) If Pi, P2, N satisfy (fTTj) with strict inequality, then there exist no encoding rules, 
which, when combined with the optimal conditional expectation reconstructors, 
result in (D*,D 2 ) as defined in ([15]) such that 

D\ = and D* 2 < D 2 \ 

Statement C) can be proved using arguments similar to those used to prove State- 
ment B). 



D) If Pi, P2, N satisfy (fTTl) with strict inequality, then there exist no encoding rules, 
which when combined with the optimal conditional expectation reconstructors, 
result in (£>*, D%) as defined in (jlS]) such that D* < D\ and D\ < D 2 or such 
that D\ < and D* 2 <D%. 

To show Statement D) we proceed by contradiction. To this end, consider two vari- 
ations of our uncoded scheme. Call these two variations "Scheme Ui" and "Scheme 
U2" . Let Scheme Ui be given by the channel inputs 

Kk = \/|K fe and *S = °' 

and the optimal conditional expectation reconstructors Si = E[Si Y] and S2 = 
E[S2 Y]. The resulting distorion pair (D 1 ^ 1 , D^ 1 ) is given by 

1 Pi + N 2 Pi + N 

Similarly, let Scheme U2 be given by the channel inputs 

= ^d X% = ^S 2 , k , 

and the same optimal conditional expectation reconstructors as for Scheme Ui. The 
resulting distorion pair {D^ 2 , D 2 2 ) is given by 

l-p 2 )P 2 + iV nU2 _ , N 



P 2 + N 2 P 2 + N' 



Now assume there would exist a coding scheme as described in D). Since D 2 X > D 2 
and -D" 2 > Df it would follow from time-sharing either with Scheme Ui or Scheme 
U2 that Statement B) or Statement C) is false. 



E) If Pi, P2, N satisfy (|17p with strict inequality, then there exist no coding scheme 
resulting in (D\, D 2 ) as defined in (f46|) such that 

D{ < D\ and D* 2 <D^, 

(be the reconstruction rule optimal or not). 

Statement E) follows from D) because no reconstructor (jy™ can outperform the 
optimal conditional expectation reconstructor Sj = E [Sj Yl. 
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By Statement E) it follows that if Pi, P2, N satisfy (|17p with strict inequality, then no 
(D\, D2) satisfying D\ < and D2 < D% is achievable. 

C.4 Proof of Lemma 1021 

By (]58p it follows that for every 5 > there exists a vq(8) > such that for all v > uq(5) 

1 n " r i 
A ? -«5<— £)E (S iifc - S iifc ) 2 <A* + ^ *6{1,2}. (67) 

Til, L 



Using (i67|) . the relation E Sf 



<D* + 5 »6{1,2}. 
a 2 , and (|45|) we obtain that 



a 2 _ D * _ s <_ J2 E [5 ljfe 5 lifc l < a 2 - I?!* + 5, 



and that 



v k=l 



<a 2 -D\ + 5. 



(68) 



(69) 



This proves Inequalities (f59|) and (j60j) . 

To prove (|6ip we note that for every cGMwe can view cSik as an estimator of S2 k 
based on Y. As such it cannot outperform the optimal estimator of S2,k given by Y, 
namely the estimator S2 = E[S2|Y]. Consequently, for every 5 > it follows by (f67l) 
that there exists an vq(5) > such that for all v > vq{$) and all c£t, 



— V E \(S 2tk - cS hk ) 2 } > — V E \(S2, k - §1 



Rewriting (|70|) gives 

Uv k=l 

and choosing 



> D* - 6. 



+ c 2 (a 2 - D{ + 5) > D* 2 -5, 



(70) 



c = 



l a 2 ~D*2-5 
a 2 -D* + 5' 



yields that for all v > vq{5) 



S2,k$l,k 



<^ a 2_ D1+d){a 2_ D *_ 6) 

= yj{^ - £>*)(a2 - D*) - 5(D* -D* 1+ 5) 



< d{a*-Dt){a* -D* 2 ) + 8(^+5). 



□ 



22 



References 



[1] A. Lapidoth and S. Tinguely, "Sending a Bivariate Gaussian Source over a Gaus- 
sian MAC," submitted to IEEE Transactions on Information Theory. Available 
on http : //arxiv . org/pdf /0901 . 3314. 

[2] A. Lapidoth and S. Tinguely, "Sending a Bivariate Gaussian Source over a Gaus- 
sian MAC," in Proceedings IEEE International Symposium on Information Theory, 
July 9-14, 2006. 

[3] J. Xiao and Z. Luo, "Compression of Correlated Gaussian Sources under Individual 
Distortion Criteria," in Proceedings 43rd Allerton Conference, Illinois, September, 
2005. 

[4] Y. Oohama, "Gaussian Multiterminal Source Coding," IEEE Transactions on In- 
formation Theory, IT-43(6), pp. 1912-1923, November 1997. 

[5] A. B. Wagner, S. Tavildar and P. Viswanath, "Rate Region of the Quadratic Gaus- 
sian Two-Encoder Source-Coding Problem," IEEE Transactions on Information 
Theory, IT-54(5), pp. 1938-1961, May, 2008. 

[6] L. H. Ozarow, "The Capacity of the White Gaussian Multiple Access Channel with 
Feedback," IEEE Transactions on Information Theory, IT-30(4), pp. 623-629, July 
1985. 

[7] A. Lapidoth and M. A. Wigger, "On the Gaussian MAC with Imperfect Feedback," 
in Proceedings 24th IEEE Convention of Electrical & Electronics Engineers in 
Israel (IEEEI'06), pp. 203-207, Eilat, Israel, November 15-17, 2006. 

[8] M. Gastpar, To Code Or Not To Code, PhD Thesis, Ecole Polytechnique Federale 
(EPFL), Lausanne, 2002. 



23 



